Method used to unzip blurred frames zips in parallel
The shell script used to unzip the blurred frames zip files is called extract_single_zip.sh and can be found in the compute-msi repository in the shell folder. The extract_single_zip.sh file takes a single argument which is the path of the zip file to be unzipped. The folder where the unzipped files are stored can be modified by modifying the DESTINATION_FOLDER variable in the shell script.
Identify all the zip files that need to be unzipped and note down their file paths. Open up separate terminal windows for each zip file that needs to be extracted. Then type out tmux to open up a tmux session for that terminal. Creating a tmux session is necessary to ensure that the unzipping of files does not terminate due to being disconnected from an ssh session.
Type out
./extract_single_zip.sh /absolute/path/to/your/zip/file
in the tmux session. Do not hit enter yet. Finish typing out the command for every zip file in the corresponding terminal window's tmux session.
After you finish typing out the command for every zip file, hit enter in each tmux session to start the unzipping process for the files.
Some information related to unzipping blurred frames for SD1 datasets SD1B and 2023_05_26:
- The unzipped blurred frames for SD1B + 202305_26 are stored in `/home/gqc/CCTV/SD1/SD1_B+_2023_05_26_blurred_frames` on the MSI Server.
- There are 766355 blurred frames stored in
/home/gqc/CCTV/SD1/SD1_B_+_2023_05_26_blurred_frames. - The unzipping process took around 5 minutes to complete for all the 766355 blurred frames.